Generation and use of user-selected scenes playlist from distributed digital content

ABSTRACT

A digital content package includes first content comprising a video feature such as a motion picture or the like, and a user-selectable application configured to operate as follows. When activated using an icon off of a menu screen, the application records an identifier for scenes (discrete portions) of the first content that are selected by a user to generate a playlist. The user may select the scenes by indicating a start and end of each scene. The application saves the playlist locally, then uploads to a server. Via a user account at the server, a user may publish the playlist to a user-created distribution list, webpage, or other electronic publication, and modify the playlist by deleting or reordering scenes.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No. 16/994,133 filed Aug. 14, 2020, which is a continuation of U.S. patent application Ser. No. 15/691,362 filed Aug. 30, 2017, now U.S. Pat. No. 10,748,578, which is a continuation of U.S. patent application Ser. No. 12/533,970 filed Jul. 31, 2009, now U.S. Pat. No. 9,754,625, which claims priority pursuant to 35 U.S.C. § 119(e) to U.S. provisional application Ser. No. 61/085,351, filed Jul. 31, 2008, which applications are hereby incorporated by reference in their entireties.

BACKGROUND 1. Field

The present disclosure relates to a system and method for enhancing user interface features associated with distributed digital content.

2. Description of the Related Art

Motion picture feature films and similar audio-visual digital content is often distributed as a package of digital content formatted for play by a specialized player according to a specific standard. For example, movies, television episodes, and similar content are often encoded as digital data on optical media such as HD DVD or Blu-ray discs, and distributed in distributed in packages of one or more discs. Each digital content package may consist of a specific set of binary files formatted according to an applicable audio or video codec, representing various parts of an interlinked media presentation when played by the appropriate media player. For example, one file may be played to present a feature film, while other files are played to present various menus and special features on a consumer display device, such as a video monitor. All of the files are characteristically configured to be playable using a media player compliant with a specific standard, which specifies various video or audio codecs, for example, MPEG-2, MPEG-4 AVC, SMTPE-VC1, Linear PCM, and Dolby Digital. Supported codecs require limitations on the digital content that is to be played, and data or executable files that do not comply with a supported codec cannot generally be played using a standard media player. The HD DVD standard is no longer supported, and applications written for HD DVD may need to be migrated to Blu-ray for future distribution. Information concerning the HD DVD standard is available from the DVD Forum at www.dvdforum.org. Information concerning the Blu-ray standard is available from the Blu-Ray Disc Association at www.blu-raydisc.com. Unlike the DVD standard, the HD DVD and Blu-ray standard include built-in support for network connectivity.

Digital content packages formatted to specific Blu-ray or equivalent standards are usually provided on a physical media, such as an optical disc. These standards were specifically developed for optical media, and are designed to provide a specified data density for media compliant with the applicable standard, among other things. Digital files encoded on media compliant with these standards, in turn, must comply with published video or audio codecs specified by the applicable standard. While physical media is usually employed, a digital content package consisting of files that comply with all requirements of a particular standard need not be encoded on an optical disc. Such a digital content package may be streamed via a wide area network, wirelessly broadcast, and/or stored on a variety of different computer memories, while retaining all the characteristics of a compliant content package, including consistent adherence to specific audio-video codecs for encoding of audio-video data, and strict avoidance of executable or other data not compliant with the applicable standard. Such characteristics make the compliant digital content package suitable for use by any compliant media player to provide audio-video output.

The personal home viewing of a motion picture or other thematically coherent audio-video work is, for some users, not merely a passive entertainment experience. Some users desire to interact with the audio-video work in more critical and creative ways to produce derivative works that, while limited in scope, reflect their own personal tastes and creative abilities. For example, this phenomenon can be seen at work at

Internet sites such as hosted by YouTube and others, wherein users borrow freely from copyrighted content in audio-video works to create and publish new but derivative audio-video works. Presently distributed digital content packages do not provide tools for allowing any type of derivative work creation within the scope of an accompanying license. As a result, many if not most amateur derivative works based on published digital content packages for audio-video works are produced using inconvenient external computer and editing tools in violation of license terms, are often of poor quality, and may sometimes be harmful to the interests of the copyright holder. It would be desirable, therefore, to provide systems and methods that enable creation and publication of derivative works based on published audio-video works while avoiding the problems and limitations of the prior art.

SUMMARY

The present technology provides an application and method whereby an end user may prepare and publish an amateur derivative work of controlled scope and quality from an audio-video work published as a fixed digital content package, without requiring additional editing tools and software beyond what is provided embedded in the digital content package itself. For example, a consumer of a Blu-ray disc may need nothing more than the disc and a standard Blu-ray player with remote control to produce a derivative work made of selected scenes (or “playlist”) from a motion picture or other audio-video content encoded on the disc. To publish the derivative work, the user need only provide an Internet connection for the media player, through which the playlist may be uploaded to a system server. Once the playlist is located at the system server, the user may log into a service interface of the server to view the playlist, edit the playlist if desired, and publish the playlist to a selected forum or distribution list. Meanwhile, the system server may track and control playlist distribution and the scope of allowed edits to ensure compliance with applicable terms of the underlying content's copyright, if any.

Further details and features of the present technology are described in the detailed description that follows.

DESCRIPTION OF DRAWINGS

FIG. 1 is a system diagram showing various exemplary elements of a system 100 in which methods described herein may be performed, or applications as described herein may operate.

FIG. 2 is a block diagram showing an exemplary content package in more detail, in combination with selected system elements that interact with the content package to provide scene selection and use features.

FIG. 3 is a screenshot showing exemplary interactive features for controlling generation of a playlist in response to user input.

FIG. 4 is a flow chart showing exemplary steps of a method for generation and use of a user-selected scenes playlist from a content package configured for play on a media player.

In the figures and in the detailed description, like element numerals are used to indicate like elements appearing in the figures.

DETAILED DESCRIPTION

Referring to FIG. 1 , system 100 may comprise a remote playlist server 102 hosting a user interface for playlist management and a database of user-provided playlists provided via a playlist-generating application included in an original digital content package. The original digital content package may be encoded on a specific media according to an applicable standard for digital audio-video data, for example, on an optical disc media 104 for play in a compatible media player 106 located remotely from the server 102 to provide audio-video output. As mentioned already, suitable standards may include, for example, HD DVD, Blu-ray, or proprietary digital set-top box protocols. In the alternative, or in addition, the original digital content may be encoded in some other medium or device, such as magnetic media or a flash memory device, accessible to player 106. Yet another alternative is to broadcast or stream the original digital content package from a network source (not shown) to a remotely located set-top box 108, which may cache the original digital content package on a local storage medium or memory device for local playback.

Either or both of the media player 106 or set-top box 108 may be connected via a wired or wireless connection to an audio-video output system 110, for example, a television monitor with integrated audio amplifier and speakers. The audio-video output system 110 may be viewed by a user 112. Using a remote control 114 or other suitable user input device, the user may provide control feedback to a relevant one of the media player 106 or set-top box 108, controlling play of the audio-video content encoded in the original digital content package. Similarly, a user 112 may provide input to a playlist application included in the original content, to be described further herein, for authoring, viewing, and editing a playlist based on the original content, and optionally, uploading the playlist to a network site for further operations.

Server 102 may be in electronic communication with player 106 or set-top box 108 via WAN 126. In the alternative, or in addition, the player 106 or set-top box 108 may communicate with server 102 through a dial-up telephone line, cable network, satellite network, or other communications network. Generally, one playlist server may be in communication with a large plurality of first content players 106, 108 for different users and any number of ancillary devices 128 for receiving playlists and other data from the players or set-top boxes.

Within an exemplary system 100, an original content package 200 as shown in FIG. 2 may be produced and delivered to a media player for an applicable audio-video standard. As permitted by the HD DVD and Blu-ray standards, the content package may comprise a plurality of interlinked files 202, for example a main audio/video program file 204 and root menu file 206. These files may also include a special features file 210 having a link to a special application 212 for authoring and managing a playlist. Special application 212 may be coded in an application compatible with the applicable media player. For example, for use with a Blu-ray player, application 212 may be coded in Java ME. Digital set-top boxes may also be programmed to provide the network connectivity and interactive features as described herein, and may be coupled with Digital Video Recording (DVR) capability for storing first content packages transmitted to the set-top box from a computer network, cable network, or digital broadcast source.

Original content 200 when played on content player 220 may cause a menu to appear on display 222. The displayed menu may include one or more links 210 inviting the user to create a playlist, view a saved playlist, edit a playlist, or upload a playlist to a network site. For example, the displayed menu may invite the user to begin creation of a new playlist. The user 226 may select the link via a user interface device 224 in communication with player 220, for example, a Blu-ray remote control device with directional keys and an “enter” or “select” button. When the link is thus selected using the interface device, application 212 may operate in response to selection of the link, causing a second interface screen displaying instructions for creating a playlist to appear, with a second link for initiating creation of a playlist. In addition, the application may cause a screen or link to a screen to appear, inviting the user to name the playlist to be created by selecting alpha-numeric characters from on-screen menu. In the alternative, or in addition, the application may automatically assign a name to the new playlist based on a predetermined naming convention.

The application may be configured to receive playlist data after receiving input for initiating creation of a playlist. Although playlist data may take various forms, in one useful embodiment, the playlist consists essentially of a sequence of time values corresponding to a timeline for the sampled content, together with an identifier for the sampled content and optionally, metadata such as, for example, a playlist author and/or device identifier, date/time of creation, dates/times of edits, and time required to play the entire sequence of cuts represented by the playlist. Each time value in the list indicates alternating “start” and “stop” values for a continuous audio-video segment of the original content. Application 212 may be configured to enable a user to select these time values making up the playlist using a suitable interface operating on the media player 220.

One suitable interface for selecting time values may include a “start” icon 302 and “stop” icon 304 that are displayed on the screen 300 overlaying the original video content 306, optionally with a status indicator icon 308, as shown in FIG. 3 . Each icon may be configured to interact with user input from a remote control or similar input device, using methods as known in the art. For example, in response to directional input from a remote control device, the application 212 may toggle a highlight between the “start” icon 302 and “stop” icon 304. In response to selection input from the remote control, the application may record the current timeline value of the original content when the start icon is selected, as a start time value. Conversely, the application may record the current timeline value in response to selection of the “stop” icon, as a stop time value. In the alternative, a single “start/stop” icon may be used for selecting both start times and stop times, in alternating sequence. Whatever the arrangement of icons, the application may display a status indicator icon 308, which may pulse, blink, indicate the passage of time, or be otherwise animated, to alert the viewer that a “start” command has been activated until a subsequent “stop” selection is received. When a “stop” command has been received by the player, causing the application to record a stop time value, the application may cause the status icon to disappear or change in appearance, to indicate to the viewer that the concurrent video portion is not being selected for inclusion in the playlist. During operation of the application 212 to record user input defining a playlist, regular navigation controls for the original content may be configured to operate normally. Thus, for example, a user may be able to “reverse,” “fast forward,” “skip” forwards or backwards, “pause,” “resume” or execute other navigation commands, at least at times when the original video is not being selected for inclusion in the playlist. At times when user input has caused the application to select the original video for inclusion in the playlist, it may be desirable (but not required) to disable some or all navigation functions, to prevent inordinately long or backwards-running scenes from being selected for inclusion in the playlist. When scene selection is complete, the application may receive input, for example selection of a “playlist finished” icon 310, indicating no more start/stop values are to be added to the playlist. In response to such input indicating the playlist is finished, application may store the finished playlist in an available memory of player 220.

In the alternative, or in addition, other interfaces may be presented to the viewer to facilitate playlist selection. For example, the application 212 may present a timeline of the original content in one or more screens, with or without thumbnail images relating to the original content at corresponding locations along the timeline. The timeline may be formatted to permit the user to highlight and select portions of the timeline for inclusion in the playlist. However, this approach suffers from the disadvantage of requiring a specialized interface for scene selection. In contrast, the use of interactive selection icons as previously described requires relatively little programming overhead and bandwidth.

Whatever selection interface is used, the selection process as implemented by application 212 may result in a completed playlist in an available memory of player 220. Application 212 or another application included in the original content package may output a menu interface for viewing, editing, deleting, and uploading one or more stored playlists. Application 212 or a cooperating application may be configured to retrieve stored playlists from available memory and present a command interface via the player display, in response to user selection of the application from a special features menu of the original content package. In response to additional user inputs received through a player interface device, the application may allow the user to add or delete scenes from a particular playlist, change the length of an existing scene in a playlist, or select and attach a soundtrack to replace or supplement the sound accompanying each scene in the original content from which the scene is selected. Other editing features may also be provided, such as enabling addition of a voice-over soundtrack via microphone input, addition of user-selected icons, graphics, or clip art in an overlay, or outside of the frame of the video, or addition of textual subtitles or commentary in as an overlay, outside of the frame, or in a speech bubble graphic. While there may be no limit in theory to the number and complexity of editing functions that may be provided, in practice, cost and bandwidth limitations, as well as inherent limitations of the user interface for the player and player memory, may limit or prevent the installation of an editing capability on the player platform. In the alternative, or in addition, editing functionality may be provided at a remote network playlist server 250 to which the playlist may be uploaded via the player's network connection.

Accordingly, the application 212 may be configured with an upload command on a menu screen, in association with one or more stored playlists. In response to receiving user input indicating selection of an upload command for a designated one or more playlists, the application may transmit the designated one or more playlists to a designated network playlist server 250. Network playlist server 250 may be a predetermined site accessed via a network address coded into the original content package or via a later-determined address pushed or pulled to the player device in response to generation of a playlist or other trigger. In the alternative, or in addition, application 212 may receive input via the user input device specifying an address to which the playlist may be uploaded. However, for most implementations, user determination of the upload address may neither be practical nor desirable. Use of a system-determined address may prevent communication problems arising from uploading a file to an incompatible address, as well as preventing uncontrolled use of the playlist.

As described herein, a playlist consisting essentially of a sequence of start and stop values and related metadata should be of little interest or value unless coupled to the original content to which the playlist relates. By the same token, playlists may be configured such that little or no threat of copyright infringement is created by free distribution of the playlist. For example, playlists may be configured such that they can be used to generate a viewable video clip only by a device possessing an authorized copy of the original content from which the playlist was generated, capable of generating a video clip using the playlist and the original content as inputs. Such a playlist may contain no copyrighted content, and may consist instead only of the numeric playlist values, administrative metadata, and user-supplied content (for example, voiceover audio files), if any.

Therefore, a network playlist server 250 to which playlists may be uploaded may be provided with a copy of the original content and may be configured to permit generation and viewing of the video clips by users that do not possess original copies of the underlying content from which the playlist was generated, subject to restrictions as desired by the copyright holder. For example, the network site may enforce a restriction that no playlist have a total play time longer than a specified percentage of the feature content length or longer than a fixed maximum time; a restriction that certain defined scenes or portions of scenes cannot be included in a published video clip; a restriction requiring video clips to be generated at a screen resolution less than a defined maximum; or any combination of these or other restrictions. In the alternative, or in addition, uploaded playlists may be manually reviewed to ensure that the video clips generated thereby do not contain offensive, derogatory, or other user-supplied content that does not comply with a defined standard, before being approved for publication or distribution.

Subject to such restrictions and review, video clips generated from uploaded playlists may be viewed by any user visiting the site. Optionally, the site may require visitors to establish an account and log in before providing access to video clips or other content. One of the benefits of maintaining such a site, beside attracting traffic from content consumers to advertise or sell related content items, may be to gather information concerning which scenes of a motion picture or other entertainment feature are of the greatest interest to viewers. Therefore, the playlist server 250 may maintain statistics concerning video clip views, and analyze such viewing statistics in conjunction with playlist data to draw inferences concerning the popularity or attractiveness of various scenes. Such analysis may be useful for developing promotional materials or future content. Consent for publication and other use of the uploaded playlist may be obtained from each user prior to uploading the playlist to the network site, for example via a shrink wrap license of the original content package, a click-through license at the time of uploading the playlist, or both.

While providing access to video clips at the playlist server 250 itself is undoubtedly of value, it may also be desirable to export video clips for use by consumers on other media devices, including but not limited to personal computers, thin clients, mobile telephones, personal digital assistants, compact media players, and so forth, on which no authorized copy of the original content resides. Therefore, in response to user input received at the network site, appropriately formatted media files compliant with applicable content restrictions may be automatically generated by the site, in response to user input. For example, the site may serve a web page permitting each user to select their own or other users' stored playlists for exporting to an alternative platform. In response to a user request received through such a page, the site may generate a video clip using the playlist and original content, which may be viewed on other platforms not possessing an authorized copy of the original content. Likewise, the site may distribute such exportable video clips to remote addresses as indicated via user input.

Similarly, the playlist server 250 may be configured to provide users with more complex and capable tools for editing playlists and supplementing them with user-provided content than may readily be provided at the media player level. Possible editing functions may include those functions already mentioned, and various other functions limited only by the imagination of the site designer and desired restrictions on the scope or content of derivative works that may be produced using the site.

Optionally, the playlist server may maintain separate accounts for each user that uploads a playlist via a content player playing original digital content packages. Such accounts may be accessed via a web interface in a conventional fashion. The web interface may be configured to allows users to view, edit and delete uploaded playlists, publish playlists to selected on-line forums or distribution lists, view account records of past activity, pay account balances, indicate addresses for destination devices to receive exported video clips, obtain and manage customer loyalty points, and generally provide electronic commerce services associated with the original digital content and uploaded playlists.

In accordance with the foregoing, FIG. 4 shows exemplary steps of a computer-implemented method 400 such as may be implemented by a playlist application operating on a media player of the foregoing systems, in cooperation with other system elements as already described. Steps of method 400 and related actions may be implemented in a processor of the media player by coding appropriate instructions in a computer language in an application embedded in original digital content distributed to the player device. Resulting executable code comprising one or more applications may be encoded on a computer-readable medium and used to cause the media player to perform the related steps and actions.

Prior to activity at the playlist server, a original digital content package with an embedded application may be distributed 402 to one or more specialized media players, for example, HD DVD or Blu-ray players, or to a digital set-top box. Production of the original digital content package and embedded application may be in accordance with the foregoing disclosure, and the application should be configured to operate on the intended media player in the manner described herein. The original digital content may be distributed on physical media such as optical disks, or transmitted for storage or caching on a local memory device accessible by the media player device.

At 404, the media player may be operated with a connection to a WAN or other communication network, configured to upload user-generated playlists to a remote site in response to user input received at the media player, to play the original content package. In response to user selection of a special features command, an application for generating a playlist may be executed 406 from the original content. The application may operate as previously described in more detail to define user-selected time values 408 in response to user input to the player device, wherein the user selected time values define a sequence of scenes or clips taken from the original content, as measured against an original content timeline. Optionally, in response to user input the application may receive user-supplied digital content or supplemental content 410 included in the original content or player memory, and associate the user supplied content and/or supplemental content with a timeline for the playlist. At 412, the application may store a defined playlist and any user-supplied content or supplemental content, if any, in an available memory of the media player.

Various optional operations may be performed by the application on the stored playlist. For example, the application may, in response to user input, display a video clip 414 generated from the playlist, original content, and user-supplied or supplemental content. In addition, or in the alternative, the application may edit a stored playlist 416, in response to user input, as previously described. Still further, the application may upload a stored playlist and associated metadata or content data 418, if any, to a designated network site, again in response to user input. The application may configure the uploaded playlist such that it cannot be used to generate a video clip unless on a device that includes a copy of the original content from which the playlist was generated. For example, the uploaded playlist file may lack any portion of the original content data.

Having thus described a preferred embodiment of a system and method for enabling generation and use of a user-selected playlist using original entertainment content operating on a specialized media player, it should be apparent to those skilled in the art that certain advantages of the within system have been achieved. It should also be appreciated that various modifications, adaptations, and alternative embodiments thereof may be made without departing from the scope and spirit of the present technology. For example, a playlist application embedded in a HD DVD or Blu-ray disc has been described, but it should be apparent that the novel concepts described above may be applied by one of ordinary skill to other forms of first digital content packages to thereby realize the benefits described herein. 

What is claimed is:
 1. A method comprising: receiving, by a media player device, a digital content package including digital audio-video content; playing the digital content package by the media player device; display at least one interactive icon for time selection in video output from the digital audio-video content during the playing; enable selection of start time values and stop time values from the digital audio-video content by a user during the playing using the at least one interactive icon; store a playlist comprising the start time values and the stop time values selected by the user; and outputting a menu interface enabling the user to select at least one function selected from viewing, editing, deleting or uploading the playlist.
 2. The method of claim 1, wherein the digital content package includes an application, and the method further comprises executing the application by the media player device in response to a user input, causing the media player device to record the start time values in response to user selections of a start one of the at least one interactive icon and record the stop time values in response to user selections of a stop one of the at least one interactive icon.
 3. The method of claim 2, wherein the executing is performed in response receiving menu selection input via a user interface indicating selection of the application by a user.
 4. The method of claim 1, wherein the function for uploading the playlist uploads to a server that restricts video generated from the playlist to a total play time of the playlist not longer than at least one of a specified percentage of the digital audio-video content file or a fixed maximum time
 5. The method of claim 1, further comprising transmitting the playlist with an identifier for the digital audio-video content from the media player device to a remote server, in association with a user account identifier.
 6. The method of claim 1, further comprising retrieving a selected playlist from one or more stored playlists, in response to user selection input.
 7. The method of claim 1, wherein the function for editing comprises at least one of enabling the user to add or delete scenes to/from the playlist, change the length of a scene in the playlist, or select and attach a soundtrack to replace or supplement a soundtrack accompanying the scene.
 8. The method of claim 1, further comprising generating an audio-video content file distinct from the digital audio-video content at least in part by sampling the digital audio-video content based on the playlist.
 9. The method of claim 8, further comprising modifying the audio-video content file in response to user input by at least one of: adding a voice-over soundtrack via microphone input, adding icons, graphics, or clip art, or adding text.
 10. The method of claim 1, wherein receiving the digital content package comprises reading the digital content package from a disc player.
 11. The method of claim 1, wherein receiving the digital content package comprises receiving the digital content package in a streaming format from a computer network.
 12. A media player device comprising at least one processor coupled to a memory, the memory holding program instructions that when executed by the at least one processor cause the media player device to: display at least one interactive icon for time selection in video output from digital audio-video content during playing by the media player device; enable selection of start time values and stop time values from the digital audio-video content by a user during the playing using the at least one interactive icon; store a playlist comprising the start time values and the stop time values selected by the user; and output a menu interface enabling the user to select at least one function selected from viewing, editing, deleting or uploading the playlist.
 13. The media player device of claim 12, wherein the memory holds further instructions for causing the media player device to record the start time values in response to user selections of a start one of the at least one interactive icon and record the stop time values in response to user selections of a stop one of the at least one interactive icon.
 14. The media player device of claim 12, wherein the memory holds further instructions for causing the media player device to send the playlist with an identifier for the digital audio-video content from the media player device to a remote server, in association with a user account identifier.
 15. The media player device of claim 12, wherein the memory holds further instructions for causing the media player device to retrieve a selected playlist from one or more stored playlists, in response to user selection input.
 16. The media player device of claim 12, wherein the memory holds further instructions for causing the media player device to generate an audio-video content file distinct from the digital audio-video content at least in part by sampling the digital audio-video content based on the playlist.
 17. The media player device of claim 12, wherein the memory holds further instructions for causing the media player device to receive the digital content package by one or more of reading the digital content package from a disc player or receiving the digital content package in a streaming format from a computer network.
 18. A method comprising: receiving, by at least one server, a playlist and an identifier for audio-video content from a remote player device, wherein the playlist comprises a list of time values from a timeline of the audio-video content indicating a sampling sequence selected at the remote player device in response to input from an input device; and enabling, by the at least one server, generation of one or more audio-video clips based on the playlist including a portion of the audio-video content in response to user input, subject to a restriction that each receiving node must be an authorized licensee of the audio-video content from which the playlist was generated.
 19. The method of claim 18, wherein the enabling generation is further subject to a restriction that total play time of the playlist is not longer than at least one of a specified percentage of the digital audio-video content file or a fixed maximum time
 20. The method of claim 18, further comprising at least one of: serving an interface from the at least one server enabling uploading of additional audio or video data to the at least one server, and storing the additional audio or video data in association with the playlist for use in generating an audio-video file including content from the digital audio-video content and the additional audio or video data, and determining whether the audio-video file complies with the one or more restrictions further comprising a restriction limiting video resolution to no greater than a defined maximum. 